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ABSTRACT 

Results of two studies of the relationship of 
flexibility and speed of closure with structural, lexical, and 
concrete/abstract cloze depletion strategies were compared. The first 
study used 113 high school students as subjects, and the second used 
92 college students. All were given a variety of cloze tests and 
adapted portions of tests of associational fluency and verbal 
comprehension. Tntercorrelations were computed for each experimental 
group, and factor analyses were made. Marked differences were noted 
between the high school and college groups. The high school sample 
had 65 of 66 significant (p<, 05) correlations, while the college 
sample had 32 of 66. Fifteen of the 16 perceptual ability 
correlations were significant for the high school sample compared to 
five for the college sample, all verbal ability measures were 
significant for the high school sample compared to 10 of 16 for the 



college sample, 
for the 
for the 
followed 



and 



ma 



the magnitude of all relationships were higher 
school group. Factor analysis revealed similar results 
wo groups with a general cloze factor emerging first, 
by a perceptual factor, and a verbal ability factor. It was 



concluded that the studies lend support to 
hypothesis of varying difficulty from one 
IMS) 



differentiation 
level to another. 
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A previous study (Ohnmehtj Weaver, and Kohler, 1970) examined the 
relationship of flexibility sand speed of closure with a ntariber of cloze 
tasks representing structural, lexical, concrete, and abstract dsr.etion 
strategies. Measures of vocabulary and assoelational fliieney were included 
in the study with the hope that separable portions of cloze variation, 
rapresenting cCTomunalitles with verbal and perceptiial abilities, could 
be Identified through application of factor armlsrfcic techniques, The 
findings, based on 113 high school Sa, indicated that the cloze tasks 
could be differentiated into two diserlminable dimensions. Further, per- 
ceptual abilities exhibited relatively low but significant correlations 
with all of the cloze tasks. 

More recently, (Ohnmacht and KLeralng, 1^71) replicated the aforemen- 
tioned study with a sample of 92 college students as subjects. The first 
part of this paper summarizes these new data and contrasts the findings 
with those reported earlier. The second part of the paper considero the 
findings from a linguistic perspective, 

MSTHGO 

A battery of twelve sub-tests was administered to samples of 113 
high school and 92 college students. The high school sample spanned 
grades 9 through 12 and was drawn ffoa a semi-rural school in Northeastern 
Georgia, The college sample consisted of paid volunteers enrolled in 
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•undergraduate educational psychology at SU13Y at Albanjr, ihe •battery 
consisted of four cloze forms and two measures each for speed of closure, 
flexibility of closure, assoclational fluency, and vocabulary, A brief 
description of each test follows. Complete descriptions of all verbal 
and perceptual ability measures can be found in the Kit of Reference 
Tests for Cognitive Factors (French, Ikstrom & Price, I963) , 

Speed of Closure 

The speed of closure factor is defined as the ability to unify an 
apparently disparate perceptual field into a single percept. 

Gestalt Completion Test (test suggested by the Street Gestalt 
Completion Test ). Drawings are presented which are composed of black 
blotches representirig .parts of the objects being portrayed. The subject 
writes dcwn the name of the objects, being as specific about them as he 
can. 

^ • Concealed Words Test (teat suggested by Thurstone»3 Mutilated 
Words ) . Words are presented with parts of each letter missing. The 
subject is to write out the full word in an adjacent space. 

Flexibility of Clos^lre 

The flexibility of elosxire factor is defined as the ability to keep 
one or more definite configurations in mind so as to make identification 
in spite of perceptual distractions, 

a. Hidden Patterns Test (teat suggested by Thtirstone’s dealgns ) , 

Each item consists of a given geometrical pattern in some of which a single 
siven configuration is embedded. The task is to mark each pattern in which 
the configuration occurs. 
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b 9 Hidden Figures Test (Adaptation of the Gottschaldt Fi^x i res Test 
pQpuJ.arisad by Thiirsbone )# The task is to decide which of five geometrical 
figiires is ^bedded in a complex pattern* The difficulty level of this 
teat is high* 

Associational Fluency 

The associational fluency factor is the ability to produce words from 
a rastri ^ted area of meaning. 

a . Controlled Associations Test (test adapted from Thurstone’s test 
of this nam e)* The task is to write as many synonytns as possible (up to 
12) for each of four words ^ 

b, AsspclatiQn XV (a tea c by J* P. Guilford ). The task is to produce 
a word that is associated with both the two given words but which has 
different meaning in its relationships to each of them* 

Verbal Compra hens ion 

The verbal comprehension factor is defined as the ability to under** 
stand the English language* 

a • Wide Range Vocabulary Test (adopted from Cooperative Vo c abi^ar^ 

Test ) * This is a five^choice synonym test having items ranging from very 
each to very difficult. 

b • Advanced VocabxJ,ary Tast (adopted from a test by J* B* Carroll * ) 
This is a four-choice S3mon3mas test consist iiig mainly of difficult items. 

The ClOEe Tests 

All elo^a tests were^ so-called^ "pretests.-* That is 5 the Ss did 
not read the relevant passages in their intact form before attempting to 
complete the delated units. A standard underline of 15 spaces was sub- 
stituted for deleted words ^ and 8s recorded their reaponaes directly on 
the test pamphlets. 
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The clo^e materials ware ecnstructed from materials which had 
previously been ordered by dlfficxilty level by means of the cloze procedure 
(Miller & Coleman), The 365 IJO^word passages were divided into four 
groups of nine passages each. Sets of three sentences each were drawn 
from each of these four levels of difficulty until the required number of 
deletions were obtained, 

a. Structural cloze . This is an ”any-^word^^ deletion which fcllox^s 
Taylor’s (1954) original technique. Every fifth ’word is deleted regardless 
of its grammatical relationship, 

h. Lexical cloze . This deletion is constructed by first identifying 
all the nouns 5 verbs, and adjectives in the passage and then elliQinatlng 
every fifth noun, verb, or adjective, 

c. Abstract nouns . Abstract nouns describe "objects" that cannot 
be perceived by the senses. Abstract nouns in the passages were identic 
fiad first, and then a mechanical fifth-*-word deletion of these nouns 
carried out, 

C ghcrete nouns . Concrete nouns ware fxrBt identified (by choosing 
those nouns which did describe objects perceivable by the seTisaa) and every 
fifth concrete noun deleted. 

Data obtained frcmi both samples were separately intercorrelated and 
subjected to a principal components solution. The original high school 
study reported two, three, and four factor solutions rotated to both 
varimax and maxplane criteria. This report contrasts the three factor 
solutions for each set of data after rotation of the principal component 
structiire to the varimax criterion. 
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Tables 1 and 2 suimnarige the descflptlve statistics including 
correlations, means, end standard deviations for the college and high 
school samples rGspectively, 



Insert Tables 1 and 2 about here 



Inspection of Tables 1 and 2 discloses marked differences between 
the systems of correlations for the high school and college samples. For 
the high school sample 65 of 66 correlations are significant (p <.05) whereas 
for the college sample 32 of 66 are significant. Further, of 16 
perceptual ability correlations with cloze tasks, 15 are significant for 
the high school sample, and 5 for the college sample. Similarly, all of 
the verbal ability measures are significantly related to the cloze tasks 
for the high school sample whereas 10 of 16 are for the college sample. 
Perhaps more importantly, the magnitude of the relationships for the 
college sample are considerably less than for the hjgh school group. 

Within cloze task correlations are also lower for the college group. In 
general the means for the college sample are substantially higher than 
for the high school group without exception. 

The foregoing summary is supported by the components analyaes of 
the respective correlation matrices. For the high school sample only 
two latent roots exceeded unity whereas three roots exceeded unity for 
the college sample again indicating greater positive manifold for the 
high school sample. Table 3 presents three factor solutions rotated to 
the varimax criterion for each of the samples. 




Insert Table 3 about here 
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Inspection of Table 3 indicates that the three factor solution for 
the two samples bear certain similarities to each other. The first factoi^^ 
in both instances 5 is a general clcEe factor. The major discrepancsr 
results from the altered loadings for the aasociational fluency tasks. 

For the high school samples Controlled Associations and Associations IV 
have major loadings on this factor whereas for the Cv^llege sample 
they are nil. This reflects , in a parsimonious manner^ the lack of 
dependence of cloze performance upon associational abilities for the older 
sample* 

The second factor^ in both analysesj is a perceptual factor^ with all 
perceptual tests exhibiting their highest loadings* For the high school 
sample^ the relationships between perceptual abilities and cloze is masked 
in a varimax solution. A rotation to the maxplane criterion produced a 
correlation of *47 between the two factors with the Structural and Concrete 
cloze tests having the highest loadings on the cloze factor. (See Table TV.) 
A similar finding is demonstrated in the college sample with the Concrete 
cloze task loading directly on the perceptual factor. The decreased 
positive manifold In the college group has produced a system of correla- 
tions to which an orthogonal set of factors demonstrates a superior 
** simple structure'* fit* It should be pointed out^ however^ that the 
underlying correlations of closure teats to cloze performance are lower 
for the eollege group. 

Factor III is a verbal ability factor dominated in both instances by 
the vocabulary tests. For the high school sample Lexical and Abstract 
Cloze tasks loaded on this factor due to the relatively strong correlations 
of these tasks with the verbal ability measures. The maxplane (Table 4 ) 
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rotation repraaents these res-ults in a different way but can be Interpreted 
In the same "manner. Factor HX for the college sample represents a cleaner 
break of the verbal abilities from both olOEe and closure abilities, Thus^ 
for the col.lege sample ^ Lexical and Abstract cloze demonstrate markedly 
less dependence on the verbal ability measures# 

DISCTBSION 

in sxnuanary, both data sets indicate that the cloze tasks are factorially 
complex in that some tasks load on two factors. The high school data 
demonstrate a stronger positive manifold with cloze performance demonstrat- 
ing greater dependence on vocabilLaryj asscciational fluency, and to a 
lesser extent upon closmre abilities. The data seem to be consistent with 
a differentiation hypothesis with the data system elements displaying a 
general decri^ase in the magnitude of the intercorrelations when the college 
sample is contrasted with the high school ^^oup, Rankin (1965) suggested 
that closure factors would be more important in the perfo^nsianee of cloze 
tasks when contrasted with older Ss. These data, although trending in 
that direction, are not convincing, A study employing elementary school 
Ss, similar to those reportad here, would be useful in further evaluating 
such a hypothesis « 

Increased emphasis might be profitably placed on re— examining the 
assumptions underlying the construction and use of certain cloze tests, 
as well as exploring a broader range of deletion strategies suggested by 
a nxmloBT of linguistic analyses* Although the cloze procadi^re has been 
put to extensive use, it has not been without its critics who have 
registered soma reservations, a few of which may be worth heeding# 
Schleslnger (I968) advised against the continued usa of the cloze 
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technique, particularly if there was under question what he coll,s the 
"fine-grain structure of a sentence," Although his case is somewhat over- 
drawn, inasmuch as few researchers using the cloze technique wou3.d contend 
that they are concerned with the f jue^graln structure of one or a set of 
sentences, Sehlesinger cites two versions of a text and than proceeds to 
show what a cloze task would look like if every 2nd word were deleted: 

(1) After the tvro friends had eaten their meal, they set out to 
explore the neighboring forest, 

(2) The two friends, after they had eaten their meal, set out to 
explore the neighboring forest. 



(la) After 


two 


had their , they 


out 


explore 


neighboring • 


(2a) 


two _______ j 


after thev had their ^ 


out 


explore 


neighboring • ( 1968 ; 11 ) 



Schlesinger * s example admittedly is eKtreme--deleting every 2nd 
word- -but his over all point is worth noting: deletloii strategies focusing 

on the linguistic variable of word order or sentence structure should be 
developed* Rather than continuing to rely almost exclusively on the gram- 
matical elements of a sentence, conventionally defined by establishing 
word classes or referring to parts of speech or word categories 
abstract, eoncrete, lexical, and structural) which are treated as isolated 
entities, or "averaged," deletion strategies incorporating the grammatical 
ralational nature of these word classes are worth considering as a means 
of refining some of the strategies ctirrantly employed* Much the same 
poxat of view has been expressed by Pike (1969) showed proximity alone 
to be an inadeqimte Index of such structiiral relationships as, for example. 
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subJec'fc—V0X*b 3 by citing the two following sentences which differed only 
in their siirface str’uctures; 

The ■villagers, despite an o'ut'wa.rd actluiescence , resisted change, 

• ‘ Pike 

Despite an outward acquiescence, the villesers resis ted change. ( 1569:11) 
Whether one opts for deep or surface structure explanations, generative or 
interpretative semantics, or simply tries to steer clear of this complex and 
controversial area, it seeias clear that to treat as identical even S'urface 
structure differences in language functions contributes little to an in- 
creased understanding of the phenomenon under investigation. In the present 
study an instance of not recognising or acknowledging such differentiated 
fmictions can be found, for example, in the treatment of deleted nouns where 
no distinction is made between those nouns which serve as subject-nouns and 
those which serve as object nouns. Another source of speculation might 
be sets of lexical-deletion materials where, compared to the structural- 
deletion materials, a disproportionate number of main verbs has been 
deleted, thus perhaps posing a severe dlsadvautage if much -weight is given 
to the notion that "subjects may tend to focus on the component of a 
sentence that is most central to its meaning or conveys the greatest 
amount of information, as is generally true of the predicate phrase in a 
statement (Snyder and Hale, 1971 : 10 )." 

The difference in degree of dependence, particularly on vocab-ulary 
and associational fluency, as Is indicated by the,' comparative high school 
and college data of this report, suggests that to take into account only 
words in isolation (vocabulary) and isolated associations, while ignoring 
structural, that is syntaetiG, relations within a sentence, can provide 
only partial insights into the undoubtedly complex semantie, syntactic, 
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and associatlonal relationships witl^**^eatences. Pike (1569) has demon- 
strated this point in his study of structural aspects of contextual 
constraint ulthln sentences, ■wherein his findings reflect not only the 
worth of Incorporating one or another scheme of structural and seraantic rela- 
tionships, but also seem to demand a re-examlnatlon of the g.uestion of 
long-range constraint as well as the assumption that context influences 
predictability in only one direction — two constraint characteristics 
which are easily open to empirical test with a variety of cloze deletion 
strategies. 

As for the adequacy of the criteria currently employed to develop 
cloze tests, some re-examination and a Judicious priming also would appear 
to be in order. In particular, the notions imder lying the abstract/ 
concrete distinction could bear a closer scrutiny than it generally 
receives, Kamman and Streeter’s (1971) recent study, which compared 
Roger Brown’s proposal that the number of known, inclusive superordinate 
subordinate words was the determinant of abstractness with abstractness 
defined in terms of empirical ratings based on accessibility to the senses, 
reported that "subjects appear to rate the abstractness of a generic noun 
in. terms of the abstractness of its examplars." 

When asked whether or not ANIMAL is accessible to the 
senses as an object or thing, raters apparently trans- 
late ANIMAL into AN ANIMAL and accept some token image 
to represent the class. On the other Imnd, such 
patriarchs as CRIME, AMOUNT, and DISEASE are rated as 
more abstract Just as their subordinates are, pos- 
sibly the words in these abstract hierarchies refer 
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^n'fcj^lnslcally relatloixal sltimtlotis which, cannot 
be demonstrated by finger-pointings or photographs 
(1971:30353063 emphasis added). 

These findings suggest some refinements in the procedures for 
establishing an abstract noun categoryj thus ellnjinnting a few glaring 
inconsistencies which one occasionally finds in laaterlals currently in 
use. For eKample, while acknowledging in specified contexts the 
abstract noun-ness of such items as time s shape 3 and end (abstract 
deletions in the materials used in this reported sutdy) 3 it is difficult 
to defend— even if one. invokes only a rule of consistency — the labelling 
of girl as a concrete deletion and wife as an abstract deletlonj to say 
nothing of alloiV7ing the words homes and ornaments as abstract deletions 3 
and conversely, thousands as a concrete deletion, which, ..to make matters 
worse in this latter instance, fimctlons as the grammatical subject of 
the sentence. 

In sum, there seems to be a striking imbalance between the power 
and occasional elegence of the statistical teGhnlques which can be and 
are used to assess the close procedure, and the hardly exploited 
linguistic variables which serve, at least Implicitly, as one of the 
major underpinnings of the stimulus materials. 
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05 


14 


8-^ 


7n 

i # 


10 


02 


8, 


Hiddyri Figures 


2k 


08 


67 


65 


£0 


-05 


9. 


Controlled Associations 


69 


-03 


■J7 


01 


16 


66 


10, 


Associations IV 


47 


0-:- 


2i 


39 


4o 


48 


iljc# 


Wida Eange Tceabvlary 


24 


24 


25 


-08 


Bl 


84 


12. 


Ad/aisced Vocabulary 


20 


33 


19 


<>0 


84 


83 



O 

ERIC 



V 



Maacplane Solutioa for High School bample 



Variah lo ■ - ^ «.*«. gactor 







X bs 


II hs 


III b: 


1. 


Cloze l-Struct-iral 


64 


05 


-43 


2, 


Cloze 11 •Lexical 


8l 


-19 


o4 


3. 


Cloze lii-^Conerete 


68 


-05 


•4o 


4. 


Cloze i'/"AbBtract 


80 


-’XO 


-0^!. 


5. 


Gestalt Completion 


07 


67 


—l6 


6» 


Coucealed Words 


11 


?4 


05 


7. 


Hidden Patterns 


-:io 


36 


0-4 


8. 


Hidden Figures 


18 


64 


-03 


9. 


Controlled Associations 


6l 


11 


-36 


• 

o 

H 


Associations XV 


63 


05 


-05 


11* 


Wide Range Vocahtilary 


76 


07 


40 


12. 


Advanced Vocabulary 


?6 


CO 


45 



* S^tor X rad XX corrolate .47. Factor XII has esiantiaily zero 
correlation with X and XX • 
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